Validation of the Polish version of the DREEM questionnaire - a confirmatory factor analysis.

AIM: The aim of our study was to translate and adapt the Dundee Ready Education Environment Measure (DREEM) questionnaire developed by Roff et al. to the cultural conditions in Poland and also to validate it. Studying the learning environment is beneficial because it can identify students' perceptions of their environment and support the staff in reflecting on, planning for and combining proper teaching approaches to improve it. METHODS: The DREEM questionnaire was completed by students of all years (first-fifth) in the faculties of dental medicine at the Medical University of Lublin and the Medical University of Gdansk. The total surveyed population consisted of 650 students. Validity was separated into four phases: (1) translation validity, (2) confirmatory factor analysis, (3) concurrent validity and (4) criterion-related validity. RESULTS: Our study confirmed the original structure of the DREEM tool (GFI = 0.955, AGFI = 0.951, NFI = 0.931, TLI = 0.962, CFI = 0.964, RNI = 0.964, IFI = 0.964, RFI = 0.928, PNFI = 0.885, SRMR = 0.062, RMSEA = 0.043, 90% CI = 0.041-0.046) and obtained very good reliability rates, with Cronbach's alpha > 0.7 for all scales. Only Subscale V achieved a lower Cronbach's alpha of > 0.5. The study was conducted using the test-retest method, which is why the intraclass correlation coefficients for reliability were also calculated; individual items showed both medium and good correspondence. CONCLUSIONS: Our study provided good evidence for the reliability and validity of the Polish version of the DREEM. In conclusion, the Polish-language version of the DREEM questionnaire is a reliable and valid instrument for analysing the learning environment for dental students and its factor structure is supported by the data.

Students' perceptions of the learning environment in two Nigerian medical schools offering different curricula.

OBJECTIVE: Compare the results of administering the DREEM questionnaire in two Nigerian medical schools offering traditional and student-centred curricular respectively, to identify any differences in the learning environment and appreciate advantages of the more modern curriculum. METHODS: A survey design was used. Data was analysed using the DREEM scoring rubric. The independent t-test was used to compare results. SETTING: The DREEM questionnaire was administered to final year medical students at two participating centres. PARTICIPANTS: Final year students of a teacher-centred and a student-centred medical school. RESULTS: There were 138 respondents - 50 (96.2% of the final year students) from the teacher centred school and 88 (59.1% of the final year students) from the student-centred school. The mean total DREEM score was 117+22.3 in the former and 119 +23.6 in the latter (p = 0.798). Mean age of students in the teacher centred school was 28 ± 5.28 years, while that of the student-centred school was 23 ± 1.83 years (p < 0.05). CONCLUSION: The mean total DREEM score proximity between the schools suggests that the younger students using a more student-centred curriculum have less of an appreciation of their improved learning environment than is expected. Thus, the hidden curriculum could be lagging behind the written one. The older students in the teacher centred environment have a more mature appreciation of their learning climate. FUNDING: Personal sources.

Standing out with Professionalism: How do Students and Faculty of two different Medical Schools perceive it?

BACKGROUND AND OBJECTIVES: Medical professionalism is an essential aspect of medical education and practice worldwide. Our objective was to explore and compare the perception as recommended sanctions about professionalism lapses, using the "Dundee Polyprofessionalism Inventory I: Academic Integrity", among the faculty and the students' of two different medical schools in Saudi Arabia. METHODS: Respondents from the two medical schools in Saudi Arabia, recommended sanctions for the first time, absolute lapses in academic professionalism were determined by using the "Dundee Polyprofessionalism Inventory 1: Academic Integrity". RESULTS: On comparing the faculty and students' responses (from College of Medicine, King Saud University) with the published data (from another, unidentified medical school in Saudi Arabia) we found alignments in recommending sanctions for 14 (46.66%) behaviours among faculty and again concerning the11(36.66%) behaviours among the students of both cohorts. CONCLUSION: The results can be used to emphasise on the improved teaching and learning strategies in undergraduate medical students' understanding of professionalism.

Your professionalism is not my professionalism: congruence and variance in the views of medical students and faculty about professionalism.

BACKGROUND: Medical professionalism is an essential aspect of medical education and practice worldwide and it must be adopted according to different social and cultural contexts. We examined the current congruence and variance in the perception of professionalism in undergraduate medical students and faculty members in one medical school in Saudi Arabia. METHODS: The target population was first year to final year medical students of College of Medicine, King Saud University. Out of a total of 1431 students at College of Medicine 750 students (52 %) participated in the study. Fifty faculty members from clinical and non-clinical departments of the College of Medicine were randomly selected for this study and all participated in the study. The respondents recorded their responses through the Bristol online survey system, using a bilingual (English and Arabic) version of the Dundee Polyprofessionalism Inventory I: Academic integrity, which has 34 items. RESULTS: There are 17 lapses (50 % of the total) in professional behaviour where none of the faculty recommend the ignore sanction while students recommended a variable ignore sanction in a range of 6-29 % for different behaviours. Students and faculty recommended similar sanctions for 5 lapses (14.7 % of the total) in professional behaviours. Furthermore, there is statistically significant two level difference between the sanctions approved by faculty and students in the recommended sanctions for 12 lapses (35 % of the total (p < 0.050). CONCLUSIONS: These results raised concerns in relation to the students' understanding of professionalism. It is therefore, important to enhance their learning around the attributes of medical professionalism.

Comparison of recommended sanctions for lapses in professionalism of undergraduate medical students in a Saudi Arabian and a Scottish medical school.

BACKGROUND: Medical Professionalism is recognized as a cultural construct. We explore perceptions of the severity of lapses in professionalism of undergraduate medical students at two medical schools with different cultural contexts. METHODS: Respondents from two medical schools (Saudi Arabia & UK) recommended sanctions for the first time, unmitigated lapses in academic professionalism, using the Dundee Polyprofessionalism Inventory 1: Academic Integrity. RESULTS: While more than two-thirds of the recommended sanctions for the 30 items of poor professionalism were fully or nearly congruent among the 1125 respondents, there were substantial differences in recommended response for one-third of the items, with a strong tendency for the Saudi students to recommend more lenient sanctions than the Scottish students. CONCLUSION: The strategy of using recommended sanctions as a proxy for the perception of the severity of different lapses in professionalism may be a useful tool in learning and teaching academic professionalism among medical students in different cultural contexts.

Exploring the climates of undergraduate professionalism in a Saudi and a UK medical school.

AIM: To explore the usefulness of an online inventory for tracking medical students' understanding of the importance of lapses in academic integrity. METHOD: Respondents were asked to recommend sanctions for lapses as a proxy of their understanding of the importance of the 34 types of poor professionalism. RESULTS: The data suggest that while there is congruence, there are also substantial differences between ratings of the importance of poor professionalism, particularly in relation to data integrity, between a cohort in Saudi Arabia and one in the UK. CONCLUSION: This resource may be useful both for teaching and learning in individual schools, and particularly for the induction of doctors into organisational environments different from the one they were trained in.

Similarities and variances in perception of professionalism among Saudi and Egyptian Medical Students.

BACKGROUND & OBJECTIVE: Professionalism has a number of culturally specific elements, therefore, it is imperative to identify areas of congruence and variations in the behaviors in which professionalism is understood in different countries. This study aimed to explore and compare the recommendation of sanctions by medical students of College of Medicine, King Saud University (KSU), Riyadh, Saudi Arabia and students from three medical colleges in Egypt. METHODS: The responses were recorded using an anonymous, self-administered survey " Dundee Polyprofessionalism Inventory I: Academic Integrity". In the study 750 medical students of College of Medicine, KSU, Riyadh were invited and a questionnaire was electronically sent. They rated the importance of professionalism lapses by choosing from a hierarchical menu of sanctions for first time lapses with no justifying circumstances. These responses were compared with published data from 219 students from three medical schools in Egypt. RESULTS: We found variance for 23 (76.66%) behaviors such as "physically assaulting a university employee or student" and "plagiarizing work from a fellow student or publications/internet". We also found similarities for 7 (23.33%) behaviors including "lack of punctuality for classes" and drinking alcohol over lunch and interviewing a patient in the afternoon", when comparing the median recommended sanctions from medical students in Saudi Arabia and Egypt. CONCLUSION: There are more variances than congruence regarding perceptions of professionalism between the two cohorts. The students at KSU were also found to recommend the sanction of "ignore" for a behavior, a response, which otherwise was absent from Egyptian cohort.

Measuring the educational environment in ambulatory settings / Medición del ambiente educacional en contextos ambulatorios

BACKGROUND AND OBJECTIVES: Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. The Ambulatory Care Learning Educational Environment Measure (ACLEEM) is an inventory that was recently developed to measure the EE in postgraduate ambulatory settings. The aim of this study was to assess the psychometric properties of the inventory. METHODS: A mixed methodology was used to develop the ACLEEM including: Grounded theory (8 focus groups); a two-round Delphi technique to identify consensus; and a pilot study. The inventory was refined to 50-items after the pilot study and it was prospectively administered to a large cohort of clerks and residents in Chile during 2010-2011. Psychometric measurements included factor analysis followed by Varimax rotation for construct validity, Cronbach's alpha coefficients for internal consistency and Generalizability theory for test reliability. RESULTS: Four-hundred and eleven students responded: 151 clerks (83.9% of the target population) and 260 residents (74% of the target population) from 31 postgraduate programs. The factor analyses showed an eight factor instrument. ACLEEM was found highly reliable with a Cronbach's alpha of 0.94 and D-study revealed a reliable outcome for residency programs with at least 15 respondents with a G coefficient of 0.831. The EE perceived by residents and clerks was positive without differences between groups: 152.52 ± 23.36 (76.26%) and 150.61 ± 24.62 (75.30%), respectively (p = 0.761). CONCLUSIONS: The 50-item ACLEEM inventory is a multidimensional and valid instrument requiring only 15 respondents for reliable RESULTS: We recommend using it to measure the EE in the ambulatory postgraduate Spanish-speaking programs

INTRODUCCIÓN Y OBJETIVOS: Las percepciones de los estudiantes sobre el ambiente educacional (AE) han sido estudiadas en programas de pregrado y posgrado. El cuestionario Ambulatory Care Learning Educational Environment Measure (ACLEEM) es un instrumento desarrollado para medir el ambiente educacional en programas de posgrado ambulatorios. El objetivo de este estudio fue evaluar las propiedades psicométricas de este instrumento. MÉTODOS: Se utilizó metodología mixta para desarrollar el instrumento ACLEEM, incluyendo: teoría fundada (8 grupos focales) y panel Delfi de 2 rondas (consenso). Se realizó un estudio piloto y luego se refinó el cuestionario a 50 ítems, que fue administrado prospectivamente en una cohorte de internos y residentes chilenos durante los años 2010-2011. Las evaluaciones psicométricas incluyeron análisis factorial seguido de rotación Varimax (validez de constructo), coeficiente alfa de Cronbach (consistencia interna) y teoría de la generalizabilidad (confiabilidad). RESULTADOS: Se obtuvieron 411 respuestas: 151 internos y 260 residentes (tasa de respuesta: 83,9% y 74%, respectivamente) correspondientes a rotaciones de internado y 31 programas de posgrado en Medicina. El análisis factorial mostró un instrumento de 8 categorías. ACLEEM presentó una alta confiabilidad (alfa de Cronbach 0,94) y un estudio de generalizabilidad que mostró resultados confiables en programas con al menos 15 encuestados (coeficiente G de 0,831). El ambiente educacional percibido por los residentes e internos fue positivo, sin diferencias entre ambos grupos: 152,52 ± 23,36 (76,26%) y 150,61 ± 24,62 (75,30%), respectivamente (p = 0,761). CONCLUSIONES: El cuestionario ACLEEM de 50 ítems es un instrumento multidimensional y válido, que requiere solo 15 encuestados para contar con resultados confiables. Recomendamos su uso para medir el ambiente educacional en programas de posgrado ambulatorios de habla hispana

Reconsidering the "decline" of medical student empathy as reported in studies using the Jefferson Scale of Physician Empathy-Student version (JSPE-S).

INTRODUCTION: The suggestion that empathy "declines" or "erodes" as students progress through medical school has largely rested on observations reported from Jefferson Medical College in the United States using the Jefferson Scale of Physician Empathy (JSPE) developed by Hojat and colleagues. Now that the student version of JSPE has been administered to medical students in more than a dozen countries, it is timely to consider whether or not the Jefferson "case study" and the conclusions drawn from it are generalisable. METHODS: A literature research was conducted on MEDLINE in mid-2014 to identify studies reporting administrations of the Student version of JPSE (JSPE-S) to cohorts of medical students and the means for studies and their sub-parts conducted in Japan, South Korea, China, Kuwait, India, Iran, UK, USA, Australia, Brazil, Colombia, the Dominican Republic and Portugal. RESULTS: The means of these studies from a dozen countries outside the USA consistently cluster round 75% out of the possible maximum of 140 unlike the early Jefferson studies (although the later Jefferson means are also <120). CONCLUSIONS: These observations may support Costa et al.'s contention that "a latent growth model suggests that empathy of medical students does not decline over time" (p. 509) - or at least not significantly. But in order to understand the maturation process of medical students and trainees we need to develop more sophisticated, integrated models that combine culturally-sensitive concepts of emotional intelligence and moral reasoning with far more refined understandings of the nature of empathy required for the safe practice of patient-centred medicine.

Prevalence of lapses in academic integrity in two Pakistani medical colleges.

OBJECTIVE: To determine prevalence of professionalism lapses related to academic integrity by students Pakistani medical colleges. SUBJECTS: 520 students. STUDY DESIGN: Cross sectional. DATA COLLECTION: A validated and customized version of Dundee Polyprofessional Inventory-1 for use in Pakistani medical schools was used. The students' perceptions on 47 behaviors were explored. RESULT: The response rate of students was 92%. Ninety percent or more than 90% of student agreed that 30 of the 47 listed behaviors were wrong. Different percentages of the students admitted doing 44 (94%), out of 47 behaviors. Students thought that fellow students were doing dishonest behaviors far more frequently than they themselves were. The commonest dishonest behaviors admitted were proxy attendance (308, 64%), receiving information about the paper from a student who has already sat in the exam, or themselves providing information about a paper who have yet to sit in it (297, 62%), completing work for another student 291 (61%). CONCLUSION: There are significant issues related to academic integrity in Pakistani medical schools that require remedy. The Dundee Polyprofessional Inventory-1 as customized for use in Pakistan is a useful tool to measure professionalism lapses related to academic integrity.

Egyptian medical students' recommended responses to the Dundee Polyprofessionalism Inventory I: Academic Integrity.

The Dundee Polyprofessionalism Inventory I: Academic Integrity was administered to 219 medical students from three Egyptian medical schools. The results indicate a high level of congruence between the genders in Recommended Sanctions on a scale of 1-10 ranging from Ignore through Reprimand to Expulsion/Report to Regulatory Body. Some variations in Recommended Sanctions occurred among the age groups 17-19 years; 20-24 years, and 25 years and older. The Egyptian responses were more lenient than a Scottish medical school cohort on four lapses of professionalism and stricter on 5. The Dundee Polyprofessionalism Inventory I: Academic Integrity can be used as a 'diagnostic tool' to profile a cohort's recommended responses to 30 lapses of professionalism at undergraduate level in health professions education. That profile can be compared with another cohort to indicate parallels and differences in the importance with which different respondents (perhaps in different countries and cultures) place on generic elements of academic professionalism. This information in turn can be used to target further education in expected standards of professionalism. The process can be used as an e-learning programme as well as for needs analysis, including that for International Medical Graduates moving from one culture to work in another.

Recommended sanctions for lapses in professionalism by student and faculty respondents to Dundee Polyprofessionalism inventory I: academic integrity in one medical school in Saudi Arabia.

BACKGROUND: At a time when the Committee of Deans of the Medical Schools in the Kingdom of Saudi Arabia is entering the second phase of developing Learning Outcomes for Bachelor Degree Programs in Medicine, we investigated the current level of understanding of the importance of academic probity in one Saudi medical school. METHODS: We administered the Dundee Polyprofessionalism Inventory I: Academic Integrity to students and faculty at one Saudi medical school. RESULTS: While there was considerable concordance between the 103 Saudi students and 64 Saudi faculty, there were also some aspects of lapses in professionalism relating to academic integrity where enhanced teaching is indicated to help the students prepare for their responsibilities as doctors. CONCLUSION: These data may begin to help focus teaching about professionalism in the Saudi medical school and inform the refinement of Learning Outcomes for Bachelor Degree Programs in Medicine in the Kingdom of Saudi Arabia. The generalizability of the findings needs to be further tested to see if mapping of Professionalism learning in relatively homogenous populations such as a medical school can be robustly conducted with well-constructed stratified, representative reference groups.

An instrument for evaluating clinical teaching in Japan: content validity and cultural sensitivity.

BACKGROUND: Many instruments for evaluating clinical teaching have been developed but almost all in Western countries. None of these instruments have been validated for the Asian culture, and a literature search yielded no instruments that were developed specifically for that culture. A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching in initial medical postgraduate training in Japan. METHODS: Based on data from a literature search and an earlier study we prepared a draft evaluation instrument. To ensure a good cultural fit of the instrument with the Asian context we conducted a modified Delphi procedure among three groups of stakeholders (five education experts, twelve clinical teachers and ten residents) to establish content validity, as this factor is particularly susceptible to cultural factors. RESULTS: Two rounds of Delphi were conducted. Through the procedure, 52 prospective items were reworded, combined or eliminated, resulting in a 25-item instrument validated for the Japanese setting. CONCLUSIONS: This is the first study describing the development and content validation of an instrument for evaluating clinical teaching specifically tailored to an East Asian setting. The instrument has similarities and differences compared with instruments of Western origin. Our findings suggest that designers of evaluation instruments should consider the probability that the content validity of instruments for evaluating clinical teachers can be influenced by cultural aspects.

Validating modified PHEEM questionnaire for measuring educational environment in academic emergency departments.

BACKGROUND: The quality of the educational environment is a key determinant in postgraduate training programs. In order to evaluate and understand this environment a valid and reliable instrument is required. The PHEEM (Postgraduate Hospital Educational Environment Measure) questionnaire is one of the most widely used tools for evaluating the perception of hospital-based residents. The aim of this study was to examine the psychometric quality of the PHEEM in the context of emergency medicine program. METHODS: This study evaluated the reliability, construct validity and applicability of the Persian version of the PHEEM questionnaire using a sample of emergency medicine residents from 3 emergency medicine residency programs in Iran. Eighty-nine residents were asked to complete the questionnaire and indicate their agreement with each of the 37 statements using a 5-point Likert scale(strongly disagree: 0 to strongly agree: 4). Cronbach's alpha coefficient was calculated to determine internal consistency. Confirmatory and explanatory factor analyses were performed to assess the construct validity of the original 3 subscales of the questionnaire. RESULTS: The mean score for the total questionnaire was 2.24 (SD: 0.06). The Cronbach's alpha value was found to be 0.86. Factor analysis did not confirm the original three subscales of the PHEEM questionnaire. CONCLUSION: The Persian version of PHEEM proved a reliable and practical tool for assessing clinical educational environment in emergency medicine departments.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

BACKGROUND: Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. AIM: The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). METHODS: A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. RESULTS: Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. CONCLUSIONS: The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.